Method and apparatus for voice modification during a call

ABSTRACT

A method for voice modification during a telephone call comprising receiving a source audio signal associated with at least one participant, wherein the source audio signal comprises a voice of the at least one participant, detecting a source dialect of the at least one participant, selecting a target dialect based on at least a characteristic of a target participant and creating a modulated audio signal based on the source audio signal, the source dialect, and the target dialect and transmitting the modulated audio signal to the target participant.

BACKGROUND OF THE INVENTION

1. Field of the Invention

Embodiments of the present invention generally relate totelecommunications and, in particular, a method and apparatus for voicemodification during a call.

2. Description of the Related Art

As personal and business relationships become more global, individualsfrom different regions come into contact much more frequently. In recentyears, English has become a de facto standard for business communicationin many regions. However, accents and dialects still reflect regionaldifferences. This can make it difficult for two speakers from differentregions to understand each other, particularly on a telephone call wherethere may be no visual cues to help interpret otherwise ambiguoussounds. In some instances, audio quality may further hinder telephonecall participants from understanding different dialects and accepts. Forexample, when a person contacts a call center for technical support,they may have difficulty understanding the technician due to adifference in accents. Similarly, when non English-native speakers callinteractive voice response (IVR) systems, the system might not recognizethem or understand their words because of their accent.

What is needed is a system and method for voice modification during acall of one or more participants so that they may be better-understoodby other call participants.

SUMMARY OF THE INVENTION

Embodiments of the present invention generally relate to a method andapparatus for voice modification during a telephone call comprisingreceiving a source audio signal associated with at least oneparticipant, wherein the source audio signal comprises a voice of the atleast one participant, detecting a source dialect of the at least oneparticipant, selecting a target dialect based on at least acharacteristic of a target participant and creating a modulated audiosignal based on the source audio signal, the source dialect, and thetarget dialect and transmitting the modulated audio signal to the targetparticipant

Other and further embodiments of the present invention are describedbelow.

BRIEF DESCRIPTION OF THE DRAWINGS

So that the manner in which the above recited features of the presentinvention can be understood in detail, a more particular description ofthe invention, briefly summarized above, may be had by reference toembodiments, some of which are illustrated in the appended drawings. Itis to be noted, however, that the appended drawings illustrate onlytypical embodiments of this invention and are therefore not to beconsidered limiting of its scope, for the invention may admit to otherequally effective embodiments.

FIG. 1 is a diagram of a communications environment including variouselements which are associated with an Internet protocol (IP) telephonysystem operating in accordance with the invention;

FIG. 2 is a block diagram depicting a dialect modification apparatus inaccordance with exemplary embodiments of the present invention;

FIG. 3 is a block diagram detailing the operation of a detection modulein accordance with exemplary embodiments of the present invention;

FIG. 4 is a block diagram detailing the interaction of a conversionmodule and a modulation module in accordance with exemplary embodimentsof the present invention;

FIG. 5 is a block diagram depicting a computer system for implementingthe dialect modification apparatus in accordance with exemplaryembodiments of the present invention; and

FIG. 6 is a flow diagram for a method for call modification inaccordance with exemplary embodiments of the present invention.

To facilitate understanding, identical reference numerals have beenused, where possible, to designate identical elements that are common tothe figures. The figures are not drawn to scale and may be simplifiedfor clarity. It is contemplated that elements and features of oneembodiment may be beneficially incorporated in other embodiments withoutfurther recitation.

DETAILED DESCRIPTION

Embodiments of the present invention generally relate to voicemodification during a call. According to at least one exemplaryembodiment, two or more participants engage in a telephone call, or atelephone conference. The participants may be from different countries,regions, or the like, and may have varied accents and languageconventions not common to everyone on the call. Each participant'sdialect is detected and a speech profile is retrieved based on thedialect as well as other identifying metadata. A target dialect ischosen and one or more of the participants voices are modulated toresemble the target dialect.

The following detailed description of preferred embodiments refers tothe accompanying drawings, which illustrate specific embodiments of theinvention. Other embodiments having different structures and operationsdo not depart from the scope of the present invention.

In the following description, the terms VOIP system, VOIP telephonysystem, IP system and IP telephony system are all intended to refer to asystem that connects callers and that delivers data, text and videocommunications using Internet protocol data communications.

As illustrated in FIG. 1, a communications environment 100 is providedto facilitate IP enhanced communications. An IP telephony system 120enables connection of telephone calls between its own customers andother parties via data communications that pass over a data network 110.The data network 110 is commonly the Internet, although the IP telephonysystem 120 may also make use of private data networks. The IP telephonysystem 120 is connected to the Internet 110. In addition, the IPtelephony system 120 is connected to a publicly switched telephonenetwork (PSTN) 130 via a gateway 122. The PSTN 130 may also be directlycoupled to the Internet 110 through one of its own internal gateways(not shown). Thus, communications may pass back and forth between the IPtelephony system 120 and the PSTN 130 through the Internet 110 via agateway maintained within the PSTN 130.

The gateway 122 allows users and devices that are connected to the PSTN130 to connect with users and devices that are reachable through the IPtelephony system 120, and vice versa. In some instances, the gateway 122would be a part of the IP telephony system 120. In other instances, thegateway 122 could be maintained by a third party.

Customers of the IP telephony system 120 can place and receive telephonecalls using an IP telephone 108 that is connected to the Internet 110.Such an IP telephone 108 could be connected to an Internet serviceprovider via a wired connection or via a wireless router. In someinstances, the IP telephone 108 could utilize the data channel of acellular telephone system to access the Internet 110.

Alternatively, a customer could utilize a analog telephone 102 which isconnected to the Internet 110 via a telephone adapter 104. The telephoneadapter 104 converts analog signals from the telephone 102 into datasignals that pass over the Internet 110, and vice versa. Analogtelephone devices include but are not limited to standard telephones anddocument imaging devices such as facsimile machines. A configurationusing a telephone adapter 104 is common where the analog telephone 102is located in a residence or business. Other configurations are alsopossible where multiple analog telephones share access through the sameIP adaptor. In those situations, all analog telephones could share thesame telephone number, or multiple communication lines (e.g., additionaltelephone numbers) may provisioned by the IP telephony system 120.

In addition, a customer could utilize a soft-phone client running on acomputer 106 to place and receive IP based telephone calls, and toaccess other IP telephony systems (not shown). In some instances, thesoft-phone client could be assigned its own telephone number. In otherinstances, the soft-phone client could be associated with a telephonenumber that is also assigned to an IP telephone 108, or to a telephoneadaptor 104 that is connected one or more analog telephones 102.

Users of the IP telephony system 120 are able to access the service fromvirtually any location where they can connect to the Internet 110. Thus,a customer could register with an IP telephony system provider in theU.S., and that customer could then use an IP telephone 108 located in acountry outside the U.S. to access the services. Likewise, the customercould also utilize a computer outside the U.S. that is running asoft-phone client to access the IP telephony system 120.

A third party using an analog telephone 132 which is connected to thePSTN 130 may call a customer of the IP telephony system 120. In thisinstance, the call is initially connected from the analog telephone 132to the PSTN 130, and then from the PSTN 130, through the gateway 122 tothe IP telephony system 120. The IP telephony system 120 then routes thecall to the customer's IP telephony device. A third party using acellular telephone 134 could also place a call to an IP telephony systemcustomer, and the connection would be established in a similar manner,although the first link would involve communications between thecellular telephone 134 and a cellular telephone network. For purposes ofthis explanation, the cellular telephone network is considered part ofthe PSTN 130.

In the following description, references will be made to an “IPtelephony device.” This term is used to refer to any type of devicewhich is capable of interacting with an IP telephony system to completean audio or video telephone call or to send and receive text messages,and other forms of communications. An IP telephony device could be an IPtelephone, a computer running IP telephony software, a telephone adapterwhich is itself connected to a normal analog telephone, or some othertype of device capable of communicating via data packets. An IPtelephony device could also be a cellular telephone or a portablecomputing device that runs a software application that enables thedevice to act as an IP telephone. Thus, a single device might be capableof operating as both a cellular telephone and an IP telephone.

The following description will also refer to a mobile telephony device.The term “mobile telephony device” is intended to encompass multipledifferent types of devices. In some instances, a mobile telephony devicecould be a cellular telephone. In other instances, a mobile telephonydevice may be a mobile computing device, such as the Apple iPhone™, thatincludes both cellular telephone capabilities and a wireless datatransceiver that can establish a wireless data connection to a datanetwork. Such a mobile computing device could run appropriateapplication software to conduct VOIP telephone calls via a wireless dataconnection. Thus, a mobile computing device, such as an Apple iPhone™, aRIM Blackberry or a comparable device running Google's Android operatingsystem could be a mobile telephony device.

In still other instances, a mobile telephony device may be a device thatis not traditionally used as a telephony device, but which includes awireless data transceiver that can establish a wireless data connectionto a data network. Examples of such devices include the Apple iPodTouch™ and the iPad™. Such a device may act as a mobile telephony deviceonce it is configured with appropriate application software.

FIG. 1 illustrates that a mobile computing device with cellularcapabilities 136 is capable of establishing a first wireless dataconnection A with a first wireless access point 140, such as a WIFI orWIMAX router. The first wireless access point 140 is coupled to theInternet 110. Thus, the mobile computing device 136 can establish a VOIPtelephone call with the IP telephony system 120 via a path through theInternet 110 and the first wireless access point 140.

FIG. 1 also illustrates that the mobile computing device 136 canestablish a second wireless data connection B with a second wirelessaccess point 142 that is also coupled to the Internet 110. Further, themobile computing device 136 can establish a third wireless dataconnection C via a data channel provided by a cellular service provider130 using its cellular telephone capabilities. The mobile computingdevice 136 could also establish a VOIP telephone call with the IPtelephony system 120 via the second wireless connection B or the thirdwireless connection C.

Although not illustrated in FIG. 1, the mobile computing device 136 maybe capable of establishing a wireless data connection to a data network,such as the Internet 110, via alternate means. For example, the mobilecomputing device 136 might link to some other type of wireless interfaceusing an alternate communication protocol, such as the WIMAX standard.

FIG. 2 is a block diagram depicting a dialect modification apparatus 200in accordance with exemplary embodiments of the present invention. Theapparatus 200 comprises a detection module 202, a conversion module 204and a modulation module 206. According to an exemplary usage of thedialect modification apparatus 200, a call is initiated by a firstparticipant 210 to a second participant 216. The present invention doesnot limit the number of participants engaged in a call, however. Forexample, third participant 212 and fourth participant 214 may also jointhe established call between participants 210 and 216. The call isinitiated over a carrier network 201, where according to someembodiments, the carrier network 201 is a VoIP network and one or moreof the client devices participate in the call using a VoIP applicationinstalled on their device. According to some embodiments, the dialectmodification apparatus 200 may be housed in a media relay of anunderlying VoIP system as described in FIG. 1.

Those of ordinary skill in the art will recognize that the network 201may be any type of network, for example an IP network, or the like. Insome embodiments, carrier network 201 may be comprised of one or more ofthe elements described in FIG. 1, such as, for example, internet 110, IPTelephony System 120, Gateway 122, and/or PSTN provider 130. A mixtureof none, some or all of the devices used by participants may be VoIPdevices. For example, participant 210 calls second participant 216 via aVoIP application installed on the client device of participant 210, butsecond participant 216 receives the call via his or her analog telephonedevice operating on a PSTN or a cellular phone operating on a cellularprovider network. However, those of ordinary skill in the art wouldrecognize that the present application does not limit the dialectmodification apparatus 200 to only a VoIP network.

According to one embodiment, once the call has begun and participants(for example, participants 210-216) of the conversation have startedspeaking, the dialect modification apparatus 200 receives a source audiosignal associated with each participant. The detection module 202 thendetects the dialect of each participant based on one or more of theirvoices in the call, their caller ID, their user ID if using a VoIPnetwork, and associated metadata. In other words, the detection module202 detects a source dialect for each participant. In some instances,the metadata may further contain location information for theorigination of the call, social media profile information, contactinformation, destination of the call or the like. Taken together, thisdata can strongly predict a particular user's dialect.

In some instances, a caller identification number (CLID) can be used toretrieve a caller's location and as a result, the dominant dialect inthat area. In addition, if the service provider 201 stores a useraddress book, then the CLID can be found in a contact which, in turn,may provide more information such as physical address or location of thecaller.

Additionally, social media may be used in several ways. For example, acaller dialect may be selected based on the geographical area where theuser “checked-in” the most. Also, place of birth, where the callerstudied and the like may indicate the dialect of a caller as well. Suchinformation may generally be accessed via specialized APIS for providinguser information.

Alternatively, a sample of the participant's voice is taken from thesource audio signal by the detection module 202 and compared to existingdialects stored in a datastore 208. The datastore 208 may be arelational database, or other type of data storing service. In someinstances, the datastore 208 may be located locally or remotely from thedialect modification apparatus 200. The datastore 208 stores dialectssamples, speech profiles and other data related to voice modificationduring a call. In some embodiments, a speech profile is returned to thedetection module 202 based on the dialect matched from the datastore208.

The dialect modification apparatus 200 determines a target dialect forthe call based on a preference of the participant who initiated thecall, predominance of particular speech profiles among the participantsor the like. The conversion module 204 converts the participants' voicesinto text based on the participants detected dialects and couples thetext to the modulation module 206. For example, if one participant'sdialect was American English, the speech-to-text engine would benotified of this dialect so that the text conversion would be performedaccurately.

The text is associated with particular speech changes by the modulationmodule 206. For example, if the target dialect is “British English” andthe participant speech being converted is “Australian English”,particular words such as “good day” may be associated with a modulationchange such as separating the timing between the two words, extendingvowel sounds, or the like to conform the speech to the target dialect.

Subsequently, the text with associated modulations is converted intospeech by the conversion module 204 to create a modulated audio signalbased on the source audio signal, the source dialect and the targetdialect using well known text-to-speech conversion engines to conform tothe selected target dialect and transmitted to other client devices.Some examples of text-to-speech engines that may be used include NUANCELoguendo TTS engine, READSPEAKER, AT&T research lab conversion, or thelike. In some embodiments, the conformed, or modulated, speech isdelivered to one or more participants of the voice call, depending onthe various gaps between the speech profiles of the participants. Forexample, if first participant 210 and second participant 212 have thesame speech profile, first participant 210 will not hear a modulatedversion of the voice of second participant 212 and vice versa. On theother hand, if the speech profiles retrieved for participant 214 andparticipant 212 are different, participant 212 will hear a modulatedvoice of participant 214 and the participant 214 will hear a modulatedvoice of participant 212, where the voices are modulated to conform tothe target dialect. In some embodiments, each participant may requirethat incoming voice calls be modulated to the participant's dialect. Forexample, the first participant 210 may configure it so that theirpersonal dialect is the target dialect for all incoming calls to thefirst participant 210. Similarly, on the same call, third participant214 may configure it so that all incoming voice is modulated to thedialect of participant 214.

According to some embodiments, voice modulation is only performed if thedifference in dialect exceeds a predetermined accent threshold. Forexample, for each dialect a set of keywords/phrases are chosen that willserve as the benchmark for those dialects. The difference between theway a speaker pronounces one of the keywords will be measured againstthe benchmarked pronunciation. In some embodiments, the difference maybe measured by amplitude differences, time to pronounce a certainsyllable in a word, saying different vowels and the like. The thresholdwill be reached on a per word basis or, if the speaker was very close toa threshold a certain number of times.

According to other embodiments, text-to-speech conversion is notperformed by the conversion module 204. In these embodiments, the audioof each participant is “massaged”, or “modulated” to conform to thetarget dialect directly. Each voice call participants' voice is brokenor parsed into phonemes, or small contrastive units of sound in a soundsystem of a language. Each phoneme is analyzed by the modulation module206 in light of the target dialect, and the difference between thephoneme of the participant speech and the target dialect is identified.Based on the identified difference, the modulation module 206 modifiesthe pitch, speed, duration, or other audio qualities of the speech toconform the speech to the target dialect phoneme. In some embodiments,this phoneme conversion is performed in real-time, or with a slightdelay based on processing time of the underlying hardware of the dialectmodification apparatus 200, preserving the identity of each participantwhile making each participant easier to understand to others. In someembodiments, participants who would like to hear other participantswithout voice modulation may disable any voice modulation generated bythe dialect modification apparatus 200.

According to one example, if a participant is not engaged in a phoneconference, but is placing a call to a call center in a foreign country,the call center technician may have an accent that is difficult tounderstand for the call initiating participant. In this instance, thedialect of the call center technician is modified by the dialectmodification apparatus 200 to the dialect of the call initiatingparticipant. In other instances, the dialect is always modified to thecommon dialect in the country or state where the dialect modificationapparatus 200 is provided. In some embodiments, the modulated voice isanalyzed by the dialect modification apparatus 200 to determine whethermodulation was successful, and if not, documenting the deficiencies forfuture voice modulations. The determination of the success of modulationmay be decided based on participant feedback, or based on an analysis ofthe modulated voice with respect to the target dialect.

FIG. 3 is a block diagram detailing the operation of the detectionmodule 202 in accordance with exemplary embodiments of the presentinvention. As described above, the detection module 202 parses the voicecontent of all participants and retrieves an associate's speech profileassociated with each participant. According to FIG. 3, the detectionmodule 202 retrieves a speech profile 300 from the datastore 208 basedon the detected user dialect. In some embodiments, the selection of aspeech profile is greatly enhanced by participant metadata 301 toincrease the accuracy of the selected speech profile.

According to exemplary embodiments, the participant metadata may includesuch information as the telephone number of the participant, a caller IDof the participant, the city, state and country of the participant, avoice sample, social media information, contacts and the like. Those ofordinary skill in the art will recognize that the participant metadata301 may include any information available from a service provider whichaids in identifying the user's region or dialect information asdescribed above.

The speech profile 300 is comprised of regional information 302, dialectinformation 304, phonetic transformation information 306 and acousticinformation 308. The regional information 302 contains information aboutthe specific region a participant is calling from or is associated with,for example, the city, state, country, or the like. The dialectinformation 304 contains data identifying a speaking dialect for theparticipant. The dialect information 304 may be a pointer to a databaserecord of particular nuances of the dialect.

For instance, the database record may contain a dialect record for theSouthern United States dialect. The record for the dialect may indicatepronunciation of particular words, or the phonetics of a particularletter when speaking that dialect. The phonetic transformationinformation 306 contains data on how to transform the dialect containedin the dialect information 304 to the target dialect selected by thedialect modification apparatus 200. Finally, the speech profile 300further contains acoustic information 308, where the acousticinformation 308 dictates the acoustic differences encountered in thisparticular speech profile from various other speech profiles.

According to some embodiments, the phonetic transformation information306 and the acoustic information 308 is described in the paper entitled“Characterizing phonetic transformations and fine-grained acousticdifferences across dialects” by Nancy Fang-Yih Chen, published athttp://mit.dspace.org/handle/1721.1/65514, hereby incorporated byreference in its entirety. Further information on phonetictransformation and acoustic differences can be found in the paperentitled “Methods for Characterizing Participants' Nonmainstream DialectUse in Child Language Research”, also hereby incorporated by referencein its entirety. Both of the methods described in these two papers maybe used to compile phonetic transformation information and acousticinformation in the present application. The speech profile 300 isretrieved from the datastore 208 by the detection module 202, and usedfor further operation.

FIG. 4 is a flow diagram detailing the interaction of the conversionmodule 204 and the modulation module 206 in accordance with exemplaryembodiments of the present invention.

Voice call content 400 is passed to the conversion module 204 from thedetection module 202. According to one embodiment of the presentinvention, the conversion module 204 converts the voice call content toparsed text 402 using well known speech-to-text engines such as DRAGONNaturally Speaking, LumenVox or the like. The parsed text 402 is thencoupled to the modulation module 206 along with the selected speechprofile 300 retrieved from the datastore 208 by the detection module202.

According to one embodiment, the modulation module 206 determines, basedon the speech profile 300, what changes need to be made to the parsedtext 402, and associated particular changes with portions of the text402. The text and the associated changes are passed to the conversionmodule 204, and the conversion module 204 converts the text back tospeech in the form of the modified voice call content 406, based on thechanges indicated by the modulation module 206. The modified voice callcontent 406 is then transmitted to the appropriate call participants, asdetermined by the speech profile of each participant.

According to another embodiment, the conversion module 204 passes thevoice call content 400 directly to the modulation module 206 withoutperforming speech-to-text conversion. The modulation module 206 thenparses the voice call content 400 into various phonemes. The differencebetween the phonemes of the participant and the phonemes of the targetdialect are determined, and based on the speech profile 300, themodulation module 206 modulates portions of the voice call content 400to generate a modulated voice 404. The modulated voice 404 is modulatedaccording to the predetermined or chosen one or more target dialects.The modulated voice 404 is then relayed to the appropriate callparticipants, based on which dialect the recipients are programmed tohear.

FIG. 5 is a block diagram depicting a computer system for implementingthe dialect modification apparatus 200 in accordance with exemplaryembodiments of the present invention. The computer system 500 includes aprocessor 502, various support circuits 505, and memory 504. Theprocessors 502 may include one or more microprocessors known in the art.The support circuits 505 for the processor 502 include conventionalcache, power supplies, clock circuits, data registers, I/O interface507, and the like. The I/O interface 507 may be directly coupled to thememory 504 or coupled through the support circuits 505. The I/Ointerface 507 may also be configured for communication with inputdevices and/or output devices such as network devices, various storagedevices, mouse, keyboard, display, video and audio sensors and the like.

The memory 504, or computer readable medium, stores non-transientprocessor-executable instructions and/or data that may be executed byand/or used by the processor 502. These processor-executableinstructions may comprise firmware, software, and the like, or somecombination thereof. Modules having processor-executable instructionsthat are stored in the memory 504 comprise an dialect modificationmodule 506 and a datastore 514. The dialect modification module 506further comprises a detection module 508, a conversion module 510 and amodulation module 512. Speech profiles 515 and voice samples 516 of thevarious participants in a voice call may also be stored in memory 504.In other instances, the speech profiles and voice samples are stored ina cloud storage for access and retrieval.

The computer system 500 may be programmed with one or more operatingsystems 520, which may include OS/2, Linux, SOLARIS, UNIX, HPUX, AIX,WINDOWS, 10S, and ANDROID among other known platforms.

The memory 504 may include one or more of the following: random accessmemory, read only memory, magneto-resistive read/write memory, opticalread/write memory, cache memory, magnetic read/write memory, and thelike, as well as signal-bearing media as described below.

Those skilled in the art will appreciate that computer system 500 ismerely illustrative and is not intended to limit the scope ofembodiments. In particular, the computer system and devices may includeany combination of hardware or software that can perform the indicatedfunctions of various embodiments, including computers, network devices,Internet appliances, PDAs, wireless phones, pagers, and the like.Computer system 500 may also be connected to other devices that are notillustrated, or instead may operate as a stand-alone system. Inaddition, the functionality provided by the illustrated components mayin some embodiments be combined in fewer components or distributed inadditional components. Similarly, in some embodiments, the functionalityof some of the illustrated components may not be provided and/or otheradditional functionality may be available.

Those skilled in the art will also appreciate that, while various itemsare illustrated as being stored in memory or on storage while beingused, these items or portions of them may be transferred between memoryand other storage devices for purposes of memory management and dataintegrity. Alternatively, in other embodiments some or all of thesoftware components may execute in memory on another device andcommunicate with the illustrated computer system via inter-computercommunication. Some or all of the system components or data structuresmay also be stored (e.g., as instructions or structured data) on acomputer-accessible medium or a portable article to be read by anappropriate drive, various examples of which are described above. Insome embodiments, instructions stored on a computer-accessible mediumseparate from computer system 500 may be transmitted to computer system500 via transmission media or signals such as electrical,electromagnetic, or digital signals, conveyed via a communication mediumsuch as a network and/or a wireless link. Various embodiments mayfurther include receiving, sending or storing instructions and/or dataimplemented in accordance with the foregoing description upon acomputer-accessible medium or via a communication medium. In general, acomputer-accessible medium may include a storage medium or memory mediumsuch as magnetic or optical media, e.g., disk or DVD/CD-ROM, volatile ornon-volatile media such as RAM (e.g., SDRAM, DDR, RDRAM, SRAM, and thelike), ROM, and the like.

The methods described herein may be implemented in software, hardware,or a combination thereof, in different embodiments. In addition, theorder of methods may be changed, and various elements may be added,reordered, combined, omitted or otherwise modified. All examplesdescribed herein are presented in a non-limiting manner. Variousmodifications and changes may be made as would be obvious to a personskilled in the art having benefit of this disclosure. Realizations inaccordance with embodiments have been described in the context ofparticular embodiments. These embodiments are meant to be illustrativeand not limiting. Many variations, modifications, additions, andimprovements are possible. Accordingly, plural instances may be providedfor components described herein as a single instance. Boundaries betweenvarious components, operations and data stores are somewhat arbitrary,and particular operations are illustrated in the context of specificillustrative configurations. Other allocations of functionality areenvisioned and may fall within the scope of claims that follow. Finally,structures and functionality presented as discrete components in theexample configurations may be implemented as a combined structure orcomponent. These and other variations, modifications, additions, andimprovements may fall within the scope of embodiments as defined in theclaims that follow.

FIG. 6 is a flow diagram for a method 600 for call modification inaccordance with exemplary embodiments of the present invention. Themethod 600 is an exemplary process flow of the dialect modificationapparatus 200, implemented as the dialect modification module 506,executed on the computer system 500.

The method begins at step 602 and proceeds to step 604. At step 604, thedetection module 508 detects the dialect of one or more voice callparticipants. The detected dialects may be all the same, or each one maydiffer. The goal is to align the dialects so that all participants mayunderstand each other. The dialects are detected based on a receivedsource audio signal associated with at least one participant. The sourceaudio signal comprises a voice of the at least one participant.

At step 606, one or more target dialects are chosen for at least one ofthe one or more participants. Namely, it is not necessary that only onetarget dialect be selected for all participants. The dialectmodification module 506 can be configured to enable each participant tohear other participants' speech in their dialect. Alternatively,participants in the same region can be configured to have otherparticipants voice modulated to the dialect of the participants in thesame region, and/or vice versa. In other embodiments, the target dialectis selected based on at least a characteristic of a target participant.For example, if a target participant is from a particular region inChina, the target dialect is selected as the dialect prevalent in thatregion of China.

The method then proceeds to step 608, where the modulation module 512modulates the voice of a portion of the one or more participants of thecall to match the one or more target dialects. The modulation module 512modulates an audio signal based on the source audio signal, the sourcedialect and the target dialect. Step 608 may also comprise sub-steps610-614. At step 610, the portion of the voice which is to be modulatedis converted into text based on the detected dialect of eachparticipant. Subsequently, a speech profile is selected based onparticipant metadata at step 612. The text of the portion of speech thatis to be modulated is associated with modifications depending on theselected speech profile to match the one or more target dialects. Atstep 614, the method 600 converts the text back to speech based on theselected speech profile and the associated modifications, in the one ormore target dialects. The modulated audio signal is then transmitted tothe target recipient. The method 600 returns to step 608 and the methodterminates at step 618.

Those skilled in the art will also appreciate that, while various itemsare illustrated as being stored in memory or on storage while beingused, these items or portions of them may be transferred between memoryand other storage devices for purposes of memory management and dataintegrity. Alternatively, in other embodiments some or all of thesoftware components may execute in memory on another device andcommunicate with the illustrated computer system via inter-computercommunication. Some or all of the system components or data structuresmay also be stored (e.g., as instructions or structured data) on acomputer-accessible medium or a portable article to be read by anappropriate drive, various examples of which are described above. Insome embodiments, instructions stored on a computer-accessible mediumseparate from computer system 500 may be transmitted to computer system500 via transmission media or signals such as electrical,electromagnetic, or digital signals, conveyed via a communication mediumsuch as a network and/or a wireless link. Various embodiments mayfurther include receiving, sending or storing instructions and/or dataimplemented in accordance with the foregoing description upon acomputer-accessible medium or via a communication medium. In general, acomputer-accessible medium may include a storage medium or memory mediumsuch as magnetic or optical media, e.g., disk or DVD/CD-ROM, volatile ornon-volatile media such as RAM (e.g., SDRAM, DDR, RDRAM, SRAM, and thelike), ROM, and the like.

The methods described herein may be implemented in software, hardware,or a combination thereof, in different embodiments. In addition, theorder of methods may be changed, and various elements may be added,reordered, combined, omitted or otherwise modified. All examplesdescribed herein are presented in a non-limiting manner. Variousmodifications and changes may be made as would be obvious to a personskilled in the art having benefit of this disclosure. Realizations inaccordance with embodiments have been described in the context ofparticular embodiments. These embodiments are meant to be illustrativeand not limiting. Many variations, modifications, additions, andimprovements are possible. Accordingly, plural instances may be providedfor components described herein as a single instance. Boundaries betweenvarious components, operations and data stores are somewhat arbitrary,and particular operations are illustrated in the context of specificillustrative configurations. Other allocations of functionality areenvisioned and may fall within the scope of claims that follow. Finally,structures and functionality presented as discrete components in theexample configurations may be implemented as a combined structure orcomponent. These and other variations, modifications, additions, andimprovements may fall within the scope of embodiments as defined in theclaims that follow.

While the foregoing is directed to embodiments of the present invention,other and further embodiments of the invention may be devised withoutdeparting from the basic scope thereof, and the scope thereof isdetermined by the claims that follow.

1. A method for voice modification during a telephone call comprising:receiving a source audio signal associated with at least oneparticipant, wherein the source audio signal comprises a voice of the atleast one participant; detecting a source dialect of the at least oneparticipant; selecting a target dialect based on at least acharacteristic of a target participant; and creating a modulated audiosignal based on the source audio signal, the source dialect, and thetarget dialect; and transmitting the modulated audio signal to thetarget participant.
 2. The method of claim 1 wherein creating amodulated audio signal comprises: converting an audio signal associatedwith the participant voice to a source text; selecting a speech profilebased on metadata associated with the target participant; transformingthe source text into modified text based on the speech profile; andconverting the modified text to speech, based on the selected speechprofile.
 3. The method of claim 2, wherein the speech profile comprisesat least one of region information, dialect information, phonetictransformation information or acoustic information.
 4. The method ofclaim 2, wherein the metadata comprises at least one of a caller ID ofthe target participant, a user ID of the target participant, orinformation derived from a social media account of the targetparticipant.
 5. The method of claim 2, wherein creating a modulatedaudio signal occurs in response to detecting that a target accentthreshold has been exceeded.
 6. The method of claim 1, furthercomprising: transmitting the source audio signal to at least oneparticipant other than the target participant.
 7. The method of claim 1further comprising: analyzing the modulated voice of the participant todetermine whether the modulation was successful; and adjusting themodulation when the modulation is not successful.
 8. The method of claim7 further comprising: determining whether the modulation was successfulbased on feedback from the at least one participant.
 9. An apparatus forvoice modification during a telephone call comprising: a detectionmodule that receives a source audio signal associated with at least oneparticipant, wherein the source audio signal comprises a voice of the atleast one participant, detects a source dialect of the participant voiceand selects a target dialect based on at least a characteristic of atarget participant; and a modulation module that creates a modulatedaudio signal based on the source audio signal, the source dialect, andthe target dialect and transmits the modulated audio signal to thetarget participant.
 10. The apparatus of claim 9, further comprising: aconversion module that converts an audio signal associated with theparticipant voice to a source text, selects a speech profile based onmetadata associated with the target participant, transforms the sourcetext into modified text based on the speech profile and converts themodified text to speech, based on the selected speech profile.
 11. Theapparatus of claim 10, wherein the speech profile comprises at least oneof region information, dialect information, phonetic transformationinformation or acoustic information.
 12. The apparatus of claim 10,wherein the metadata comprises at least one of a caller ID of the targetparticipant, a user ID of the target participant, or information derivedfrom a social media account of the target participant.
 13. The apparatusof claim 10, wherein creating a modulated audio signal occurs inresponse to detecting that a target accent threshold has been exceeded.14. The apparatus of claim 9, wherein the apparatus further transmitsthe source audio signal to at least one participant other than thetarget participant.
 15. The apparatus of claim 9, wherein the modulationmodule further analyzes the modulated voice of the participant todetermine whether the modulation was successful and adjusts themodulation when the modulation is not successful.
 16. The apparatus ofclaim 15, wherein the modulation module further determines whether themodulation was successful based on feedback from the at least oneparticipant.